Method and apparatus for displaying graphical user interface depending on a user&#39;s contact pattern

ABSTRACT

A graphical user interface (GUI) may be displayed on a display unit in an apparatus which may include a tactile sensor unit. When a contact by a user is detected at the tactile sensor unit, a control unit may receive a contact detection signal therefrom. Based on the contact detection signal, the control unit may determine a contact pattern and may then display the GUI corresponding to the contact pattern. The GUI may be displayed and modified depending on the location and pressure of contacts by a user&#39;s manipulating fingers. Therefore, a user can manipulate the apparatus without any inconvenience or accidental touches.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/297,263, filed on Jun. 5, 2014, which is a continuation of U.S.patent application Ser. No. 13/928,010, filed on Jun. 26, 2013, now U.S.Pat. No. 8,749,510, which is a continuation of U.S. patent applicationSer. No. 12/548,704, filed on Aug. 27, 2009, now U.S. Pat. No.8,493,342, issued on Jul. 23, 2013, and claims priority from and thebenefit of Korean Patent Application No. 10-2008-0097591, filed on Oct.6, 2008, and Korean Patent Application No. 10-2009-0012687, filed onFeb. 17, 2009, each of which is hereby incorporated by reference for allpurposes as if fully set forth herein.

BACKGROUND OF THE INVENTION

Field of the Invention

Exemplary embodiments of the present invention relate to a graphicaluser interface (GUI) for electronic devices and, in particular, to amethod and apparatus for displaying a GUI according to a user's contactpattern.

Description of the Background

A touch screen may be used as a display unit and an input unit.Therefore, electronic devices having a touch screen may not requireadditional display and input units. Because of this advantage, a touchscreen may be widely used for limited-size electronic devices such as,for example, mobile devices, which may also be referred to as portabledevices or handheld devices.

Typically, a user can manipulate a touch screen with one hand or bothhands to command an execution of a desired function or application. Whena user uses both hands, one hand may grip a device, and the other handmay touch a touch screen of the device. However, when a user uses onlyone hand, parts of the touch screen may often be hidden by a finger(e.g., the thumb) of a gripping hand.

FIG. 10A is an illustrative example showing a user's left thumbselecting one of the menu icons displayed on a touch screen. In thisexample, if a user touches a specific icon (e.g., Music Icon) located inthe upper right portion on the touch screen, some of the other icons(e.g., Game Icon, Display Icon, and Scheduler Icon) displayed on thetouch screen may be entirely or partially hidden by the thumb.Additionally, these hidden icons may be in contact with the thumb, andthereby functions associated with the hidden icons may be undesirablyexecuted.

FIG. 10B is another illustrative example showing a user's left thumbtouching a scroll bar presented on the touch screen. If the user touchesthe scroll bar located at the right side on the touch screen, displayedcontent (e.g., scene) may be hidden by the thumb. Furthermore, somedisplayed content may undesirably be touched with the thumb andaccessed.

An electronic device having tactile sensors may provide control ofelectronic device applications only if a user keeps contact with aspecific part of the device without using a touch screen or a keypad.Such electronic devices may provide a display screen with a GUI to guidecontact-based inputs. If the GUI is displayed in a fixed form regardlessof a user's contact pattern, some positions in the GUI may fail tonote/input the user's contact. This may be due to differences inindividual hand sizes, finger sizes, and grip forms. It is difficult torealize a GUI adapted for multiple users. If no match exists between aposition in the GUI and a contact point of the user's contact, confusionmay be generated when a user manipulates applications on the electronicdevice.

SUMMARY OF THE INVENTION

Exemplary embodiments of the present invention provide a method andapparatus for displaying a graphical user interface (GUI) adapted to auser's manipulating hand.

Exemplary embodiments of the present invention also provide an apparatushaving a touch screen and a tactile sensor.

Additional features of the invention will be set forth in thedescription which follows, and in part will be apparent from thedescription, or may be learned by practice of the invention.

Exemplary embodiments of the present invention disclose a method fordisplaying a GUI on a display unit in an apparatus including tactilesensor unit. The method comprises detecting at the tactile sensor unit acontact by a user, determining a contact pattern from the detectedcontact, and displaying the GUI corresponding to the contact pattern.

Exemplary embodiments of the present invention provide an apparatus fordisplaying a GUI. The apparatus comprises a tactile sensor unitconfigured to create a contact detection signal when detecting a user'scontact, including a left sensor part and a right sensor part, eachsensor part having a plurality of sensor components, a display unitconfigured to display the GUI, and a control unit configured to receivethe contact detection signal from the tactile sensor unit, to determinea contact pattern based on the contact detection signal, and to controlthe display unit to display the GUI corresponding to the contactpattern.

It is to be understood that both the foregoing general description andthe following detailed description are exemplary and explanatory and areintended to provide further explanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this specification, illustrate exemplary embodiments of theinvention, and together with the description serve to explain theprinciples of the invention.

FIG. 1A is a block diagram illustrating an internal configuration of anapparatus according to exemplary embodiments of the present invention.

FIG. 1B shows an example of a tactile sensor unit located on lateralsides of the apparatus shown in FIG. 1A according to exemplaryembodiments of the present invention.

FIG. 2 is a flow diagram illustrating a method for displaying a GUIdepending on a manipulating hand according to exemplary embodiments ofthe present invention.

FIG. 3 is a flow diagram illustrating an example of a detailed processof the manipulating hand determination step in the GUI display methodshown in FIG. 2 according to exemplary embodiments of the presentinvention.

FIG. 4 is a flow diagram that illustrates another example of a detailedprocess of the manipulating hand determination step in the GUI displaymethod shown in FIG. 2 according to exemplary embodiments of the presentinvention.

FIG. 5 is a flow diagram illustrating another example of a detailedprocess of the manipulating hand determination step in the GUI displaymethod shown in FIG. 2 according to exemplary embodiments of the presentinvention.

FIG. 6A shows an example of a left hand grip and the tactile sensor unitlocated on a lateral side of the apparatus according to exemplaryembodiments of the present invention.

FIG. 6B shows an example of a right hand grip and the tactile sensorunit located on a lateral side of the apparatus according to exemplaryembodiments of the present invention.

FIG. 7A shows another example of a left hand grip and the tactile sensorunit located on a lateral side of the apparatus according to exemplaryembodiments of the present invention.

FIG. 7B shows another example of a right hand grip and the tactilesensor unit located on a lateral side of the apparatus according toexemplary embodiments of the present invention.

FIG. 8 illustrates an example of a GUI according to exemplaryembodiments of the present invention.

FIG. 9 illustrates another example of a GUI according to exemplaryembodiments of the present invention.

FIG. 10A is an illustrative example showing a user's left thumbselecting one of the menu icons displayed on a touch screen according toa conventional GUI.

FIG. 10B is another illustrative example showing a user's left thumbtouching a scroll bar presented on a touch screen according to aconventional GUI.

FIG. 11 is a flow diagram illustrating a method for displaying a GUIdepending on a manipulating hand according to exemplary embodiments ofthe present invention.

FIG. 12A illustrates an example of a screen on which menu icons aredisplayed in an idle screen application by a user's contact according toexemplary embodiments of the present invention.

FIG. 12B illustrates an example of a screen on which displayed menuicons are changed in an idle screen application by a user's new contactaccording to exemplary embodiments of the present invention.

FIG. 13A illustrates an example of a screen on which function icons aredisplayed in a camera application by a user's contact according toexemplary embodiments of the present invention.

FIG. 13B illustrates an example of a screen on which the displayedfunction icons are changed in a camera application by a user's newcontact according to exemplary embodiments of the present invention.

FIG. 14A illustrate an example of a screen on which function icons aredisplayed in an MP3 application by a user's contact according toexemplary embodiments of the present invention.

FIG. 14B illustrate an example of a screen on which the displayedfunction icons are changed in an MP3 application by a user's new contactaccording to exemplary embodiments of the present invention.

DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS

The invention is described more fully hereinafter with reference to theaccompanying drawings, in which exemplary embodiments of the inventionare shown. This invention may, however, be embodied in many differentforms and should not be construed as limited to the exemplaryembodiments set forth herein. Rather, these exemplary embodiments areprovided so that this disclosure is thorough, and will fully convey thescope of the invention to those skilled in the art. In the drawings, thesize and relative sizes of layers and regions may be exaggerated forclarity. Like reference numerals in the drawings denote like elements.

It will be understood that, although the terms first, second, third,etc. may be used herein to describe various elements, components,regions, layers and/or sections, these elements, components, regions,layers and/or sections should not be limited by these terms. These termsare only used to distinguish one element, component, region, layer orsection from another region, layer or section. Thus, a first element,component, region, layer or section discussed below could be termed asecond element, component, region, layer or section without departingfrom the teachings of the present invention.

Spatially relative terms, such as “beneath,” “below,” “lower,” “above,”“upper” and the like, may be used herein for ease of description todescribe one element or feature's relationship to another element(s) orfeature(s) as illustrated in the figures. It will be understood that thespatially relative terms are intended to encompass differentorientations of the device in use or operation in addition to theorientation depicted in the figures. For example, if the device in thefigures is turned over, elements described as “below” or “beneath” otherelements or features would then be oriented “above” the other elementsor features. Thus, the exemplary term “below” can encompass both anorientation of above and below. The device may be otherwise oriented(rotated 90° or at other orientations) and the spatially relativedescriptors used herein interpreted accordingly.

The terminology used herein is for the purpose of describing particularexemplary embodiments only and is not intended to be limiting of thepresent invention. As used herein, the singular forms “a,” “an” and“the” are intended to include the plural forms as well, unless thecontext clearly indicates otherwise. It will be further understood thatthe terms “comprises” and/or “comprising,” when used in thisspecification, specify the presence of stated features, integers, steps,operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this invention belongs. It will befurther understood that terms, such as those defined in commonly useddictionaries, should be interpreted as having a meaning that isconsistent with their meaning in the context of the relevant art andwill not be interpreted in an idealized or overly formal sense unlessexpressly so defined herein.

Furthermore, well known or widely used techniques, elements, structures,and processes may not be described or illustrated in detail to avoidobscuring the essence of the exemplary embodiments.

Prior to explaining exemplary embodiments of the present invention,relevant terminology will be defined for the description below.

A graphical user interface (GUI) may refer to a graphic display providedon a display (e.g., screen) of an electronic device. The GUI may includeat least one window, at least one icon, at least one scroll bar, and anyother graphical items used for inputting commands to the device by auser. It should be understood that exemplary embodiments of the presentinvention may include various types of GUIs in various shapes, designs,and configurations.

A manipulating hand may refer to an electronic device user's handengaged with manipulation of the electronic device's touch screen. Themanipulating hand may include one or more hands by which a touch actionis made on the touch screen. Additionally, the manipulating hand mayinclude one or more hands in contact with the electronic device having atactile sensor. The manipulating hand may be a user's left hand, righthand, or both hands.

A tactile sensor unit or a tactile sensor may refer to at least onesensor sensitive to a user's touch. The tactile sensor unit may bedifferent from touch sensors included in the touch screen and thetactile sensor unit may be located generally on at least one lateralside of the device. If a user grips the device, the tactile sensor unitmay detect the contact between a user's hand and the device, create acontact detection signal, and transmit the contact detection signal to acontrol unit. The tactile sensor unit may be composed of at least onetactile sensor that can detect the extent of a contact pressure and thelocation of contact/pressure. Alternatively, the combination of pressuresensors and touch sensors may be used for the tactile sensor unit. Thetactile sensor unit may include a left sensor part and a right sensorpart, each of which may be composed of a plurality of sensor components.The tactile sensor unit may be formed on the upper side and/or the lowerside, or may be formed on any and/or all sides of the device.

Sensor components may refer to elements constituting the tactile sensorunit. Each sensor component may separately detect a user's contact. Thenumber of sensor components included in the tactile sensor unit may bedetermined based on the type or size of sensor components.

A component group may refer to a set of sensor components arranged insequence among contact-detecting sensor components. The component groupmay be used for creating contact pattern information. The location ofthe component group and the number of sensor components included in asingle component group may vary according to the user's grip form.

Hereinafter, exemplary embodiments of the present invention aredescribed in detail with reference to the accompanying drawings.

FIG. 1A is a block diagram illustrating an internal configuration of anapparatus according to exemplary embodiments of the present invention.

Referring to FIG. 1A, the apparatus 100 may be a mobile communicationterminal, a portable terminal such as a personal digital assistant(PDA), a computer, a TV, or any other electronic devices having a touchscreen. The apparatus 100 may include a tactile sensor unit 110, amemory unit 120, a touch screen 130, and a control unit 140.

The tactile sensor unit 110 may detect contact of a user's hand when auser grips the apparatus 100. The tactile sensor unit 110 may detect theextent of the contact's pressure and a location of the contact/pressure.The tactile sensor unit 110 may be composed of tactile sensors, touchsensors, and/or a combination of pressure sensors and touch sensors. Thetactile sensor unit 110 may be located on a lateral side of theapparatus 100, but not limited thereto. In some exemplary embodiments,the tactile sensor unit 110 may be located on every side of theapparatus 100.

FIG. 1B shows an example of the tactile sensor unit 110 located onlateral sides of the apparatus 100. After detecting the contact of auser's hand, the tactile sensor unit 110 may transmit a contactdetection signal to the control unit 140. The tactile sensor unit 110may include a left sensor part and a right sensor part, each of whichmay be composed of a plurality of sensor components.

The memory unit 120 may store a variety of programs required forperforming functions of the apparatus 100 and data created while suchfunctions are performed. The memory unit 120 may store data related to aprocess of assuming a manipulating hand and contact pattern information.

The touch screen 130 may display information and may receive user input.The touch screen 130 may include a display unit 132 and a touch sensorunit 134.

The display unit 132 may be formed of a liquid crystal display (LCD) orany other suitable type of display. The display unit 132 may provide avariety of graphical information related to states and operations of theapparatus 100. The display unit 132 may display a GUI depending on amanipulating hand. In some cases, the display unit 132 may display theGUI according to the position of the user's fingers that grip theapparatus 100.

The touch sensor unit 134 may determine whether the user's hand(s)touches the touch screen or not. The touch sensor unit 134 may be formedof capacitive touch sensors, pressure sensors, and/or any other suitabletouch-sensitive sensors. When detecting the touch of the user's hand,the touch sensor unit 134 may transmit a touch signal to the controlunit 140. The touch signal may include coordinate data representing theuser's touch location. In some cases, the touch sensor unit 134 may benot included in the apparatus 100.

The control unit 140 may control states and operations of one or moreelements of the apparatus 100. For example, the control unit 140 mayreceive a contact detection signal from the tactile sensor unit 110 andmay determine the user's contact pattern by using the contact detectionsignal. Additionally, the control unit 140 may instruct the display unit132 to display a GUI depending on the user's contact pattern.

FIG. 2 is a flow diagram illustrating a method for displaying a GUIdepending on a manipulating hand according to exemplary embodiments ofthe present invention.

Referring to FIG. 2, the tactile sensor unit 110 may detect a user'scontact (S210). The user's contact may be a result of the user grippingthe apparatus 100. When detecting the user's contact, the tactile sensorunit 110 may transmit the contact detection signal to the control unit140.

The control unit 140 may receive the contact detection signal from thetactile sensor unit 110 (S220). Next, the control unit 140 may determinethe user's contact pattern and may thereby determine a manipulating hand(S230). Step S230 is illustrated in detail in FIG. 3, FIG. 4, and FIG.5.

After step S230, the control unit 140 may instruct the touch screen 130to display a GUI based on the manipulating hand (S240). The control unit140 may then decide whether to receive an additional contact detectionsignal from the tactile sensor unit 110 (S250). If the control unit 140decides to receive additional contact detection signal(s), the methodfor displaying a GUI may return to step S230 to redetermine the user'scontact pattern and further redetermine the manipulating hand. Theadditional contact detection signal may be provided by the tactilesensor unit 110 when the user changes a grip form.

If the control unit 140 receives no additional contact detection signalfrom the tactile sensor unit 110, the display unit 132 may maintain acurrent GUI. Thereafter, the user may manipulate the displayed GUI onthe touch screen 130 to input a command to the apparatus 100.

FIG. 3 is a flow diagram illustrating an example of a detailed processof step S230 shown in FIG. 2 according to exemplary embodiments of thepresent invention.

Referring to FIG. 3, the control unit 140 may generate at least onecomponent group based on the contact detection signal received from thetactile sensor unit 110 (S310). As noted above, the component group mayrefer to a set of sensor components arranged in one or more sequencesamong contact-detecting sensor components.

Exemplary embodiments of the sensor components and the component groupare illustrated in FIG. 6A, FIG. 6B, FIG. 7A, and FIG. 7B.

FIG. 6A shows an example of a user holding the apparatus 100 with a lefthand grip. The tactile sensor unit 110 may be located on a lateral sideof the apparatus 100. The left sensor part may be located on the leftlateral side of the apparatus 100, and the right sensor part may belocated on the right lateral side of the apparatus 100. Each sensor partmay be composed of a plurality of sensor components. The number of thesensor components may vary according to a size of the sensor components.For example, the smaller the sensor components are sized, the moresensor components may be arranged on the lateral sides of the apparatus100. In FIG. 6A, for example, the number of the sensor componentsbelonging to each sensor part may be twenty three. Marked componentsamong sensor components in the left sensor part may represent componentshaving detected contact with the left hand. Among sensor components inthe right sensor part, marked components may represent components havingdetected contact with fingers of the left hand (e.g., four fingersexcept the thumb). Contact-detecting components may be grouped by theirarrangements in sequence. For example, sequentially arranged ninecomponents in the left sensor part may be assigned to one group. And,four pairs of two components in the right sensor part may be assigned tofour groups.

Returning to FIG. 3, after step S310 of generating the component group,the control unit 140 may create contact pattern information based on thecomponent group (S320). Therefore, the contact pattern information maybe different based on how the user grips the apparatus 100. The contactpattern information may include, for example, the number of componentgroups in each sensor part, the location of component groups, theinterval between the component groups, the number of sensor componentsin each component group, and/or pressure detection data of each sensorcomponent.

Referring to FIG. 6A, the contact pattern information of the left sensorpart may contain the following data: one component group composed ofnine sensor components located, for example, from the twelfth sensorcomponent to the twentieth sensor component. The contact patterninformation of the right sensor part may contain the following data:four component groups, each of which is composed of two sensorcomponents located, for example, at the fourth, fifth, ninth, tenth,fourteenth, fifteenth, nineteenth and twentieth component positions.Three sensor components may be interposed between two adjacent componentgroups.

Returning to FIG. 3, the control unit 140 may retrieve stored contactpattern information from the memory unit 120 (S330). The memory unit 120may store the contact pattern information, and, in general, may storedifferent contact pattern information corresponding to different typesof grip. Contact pattern information stored in the memory unit 120 mayinclude, for example, the number of component groups in each sensorpart, the location of component groups, the interval between thecomponent groups, the number of sensor components in each componentgroup, and/or pressure detection data of each sensor component.

The control unit 140 may subsequently compare the created contactpattern information with the retrieved contact pattern information(S340). For example, the control unit 140 may execute respectivecomparisons of the number of component groups in each sensor part, thelocation of component groups, the interval between the component groups,the number of sensor components in each component group, and/or pressuredetection data of each sensor component.

The control unit 140 may also determine whether the created contactpattern information is within a range associated with the retrievedcontact pattern information (S350). When the created informationcorresponds completely to the retrieved information, the control unit140 may determine that the created information is within the rangeassociated with the retrieved information. If an allowable margin ispreviously assigned to the contact pattern information stored in thememory unit 120, the created information may be within the allowablemargin such that the created information may be determined to be withinthe range. The allowable margin may be respectively assigned to, forexample, the number of component groups in each sensor part, thelocation of component groups, the interval between the component groups,the number of sensor components in each component group, and/or pressuredetection data of each sensor component.

If the created contact pattern information is within the range of theretrieved contact pattern information, the control unit 140 maydetermine the manipulating hand corresponding to the created contactpattern information (S360). The memory unit 120 may already have storedinformation about different manipulating hands according to differentcontact pattern information. If the created contact pattern informationbelongs to a range of the retrieved contact pattern information, thecontrol unit 140 can determine the manipulating hand corresponding tothe created contact pattern information. The determined manipulatinghand may be the left hand, or the right hand.

If the created contact pattern information does not belong to the rangeof the retrieved contact pattern information, the control unit 140 maydetermine that the manipulating hand is both hands (S370). Afterdetermining the manipulating hand, the control unit 140 may return tothe previous step S240 of displaying a GUI according to the manipulatinghand.

FIG. 4 is a flow diagram illustrating another example of a detailedprocess of step S230 shown in FIG. 2 according to exemplary embodimentsof the present invention.

Referring to FIG. 4, the control unit 140 may generate at least onecomponent group which may be a set of sensor components arranged insequence among contact-detecting sensor components (S410). The controlunit 140 may then calculate a number of sensor components contained ineach component group (S420). For example, as noted in the example shownin FIG. 6A, a single component group in the left sensor part may havenine sensor components, and each of four component groups in the rightsensor part may have two sensor components.

After calculating the number of sensor components in each componentgroup, the control unit 140 may determine which component group andsensor part may have the largest number of contact-detecting sensorcomponents (S430). For example, the largest component group may be inthe left sensor part or the right sensor part, and accordingly thecontrol unit 140 may determine whether the largest sensor part is theleft sensor part or the right sensor part in step S430. For example,referring to FIG. 6A, the control unit 140 may determine that thelargest component group has nine sensor components and is located in theleft sensor part. Referring to another example illustrated in FIG. 6B,the largest component group may have nine sensor components and may belocated in the right sensor part. Therefore, the control unit 140 maydetermine that the largest sensor part is the right sensor part.Similarly, the largest sensor part may be the left sensor part in FIG.7A and the right sensor part in FIG. 7B.

If the largest sensor part is the left sensor part, the control unit 140may further determine whether the left sensor part has additionalcomponent groups (S440). The additional component groups may refer toone or more component groups situated in the largest sensor part butthat is not the largest component group. In FIG. 6A, for example, theleft sensor part, which is the largest sensor part, may have the largestcomponent group and no additional component group. However, in FIG. 7A,the left sensor part, together with the largest component group, mayhave one additional component group composed of three sensor componentsfrom the third sensor component to the fifth sensor component.

If there is no additional component group, as shown in FIG. 6A, thecontrol unit 140 may determine that the manipulating hand is the lefthand (S450). The largest component group may then be considered to be incontact with the palm of the left hand. Also, having no additionalcomponent group may indicate that the thumb of the left hand may not bein contact with the tactile sensor unit 110. In these cases, the controlunit 140 may determine that a user may manipulate the touch screen 130with the thumb of the left hand. That is, the user may use his or herleft hand to grip the apparatus 100 and to touch the touch screen 130.The control unit 140 may determine that the manipulating hand is theleft hand.

Similar steps may be taken if the manipulating hand is determined to bethe right hand. For example, if the largest sensor part is the rightsensor part, the control unit 140 may determine whether the right sensorpart has additional component groups (S460). If the right sensor parthas no additional component group, as shown in FIG. 6B, the control unit140 may determine that the manipulating hand is the right hand (S470).

If the right sensor part has additional component groups, the controlunit 140 may determine that both hands may be the manipulating hand(S480). The presence of additional component groups may indicate thatthe thumb of the user's gripping hand is in contact with the tactilesensor unit 110. The control unit 140 may determine that a user maymanipulate the touch screen 130 with the thumb of a non-gripping hand.So, the control unit 140 determines that the manipulating hand is bothhands.

FIG. 5 is a flow diagram illustrating another example of a detailedprocess of step S230 shown in FIG. 2 according to exemplary embodimentsof the present invention.

Referring to FIG. 5, the control unit 140 may generate at least onecomponent group which may be a set of sensor components arranged insequence among contact-detecting sensor components (S510). The controlunit 140 may calculate the number of component groups contained in eachsensor part (S520). In FIG. 6A, FIG. 6B, FIG. 7A, and FIG. 7B, thesensor parts may be the left sensor part and the right sensor part. Insome cases, the control unit 140 may calculate simultaneously the numberof component groups in the left sensor part and the right sensor part.

For example, in FIG. 6A, the number of component groups may be one inthe left sensor part and four in the right sensor part. In FIG. 6B, thenumber of component groups may be four in the left sensor part and onein the right sensor part. In FIG. 7A, the number of component groups maybe two in the left sensor part and four in the right sensor part. InFIG. 7B, the number of component groups may be four in the left sensorpart and two in the right sensor part.

The control unit 140 may determine whether the number of componentgroups is three or more in the left sensor part and one or less in theright sensor part (S530). If the number of component groups is three ormore in the left sensor part and one or less in the right sensor part,the control unit 140 may determine that the manipulating hand is theuser's right hand (S540). Three or more component groups in the leftsensor part may indicate that at least three fingers except the thumbare in contact with the left sensor part. One or less component group inthe right sensor part may indicate that the palm of the user's righthand is in contact with the right sensor part but the thumb may not bein contact. In such cases, the control unit 140 may determine that theuser may manipulate the touch screen with the user's right hand thumb.That is, a user's right hand may be used to grip the apparatus 100 andto touch the touch screen 130. Accordingly, the control unit 140 maydetermine that the manipulating hand is the right hand.

Similarly, in determining that the manipulating hand is the left hand,the control unit 140 may determine whether the number of componentgroups is three or more in the right sensor part and is one or less inthe left sensor part (S550).

If the answer is no in both steps 530 and 550, the control unit 140 maydetermine that the manipulating hand is both hands (S570).

FIG. 8 illustrates an example of a GUI according to exemplaryembodiments of the present invention.

FIG. 8 illustrates an exemplary embodiment of a display screen 810having menu icons and with the left hand determined to be themanipulating hand. The control unit 140 may arrange the menu icons fromthe upper left corner to the lower right corner of the display screen810 to correspond to a moving path of the left thumb. Accordingly, auser can select icons by touching the display screen 810 with his or herleft thumb to execute desired functions corresponding to the selectedicons. Since the menu icons are arranged along a moving path of the leftthumb, no icon may be hidden from the thumb and an unexpected touch ofan icon may be prevented.

FIG. 8 also illustrates an exemplary embodiment of a display screen 820with the right hand determined to be the manipulating hand. In suchcases, the control unit 140 may arrange the menu icons along a movingpath of the right thumb. In some other cases when both hands aredetermined to be the manipulating hand, as shown by display screen 830in FIG. 8, the control unit 140 may maintain a normal GUI changeableaccording to the user's intent.

FIG. 9 illustrates another example of a GUI according to exemplaryembodiments of the present invention.

FIG. 9 illustrates an exemplary embodiment of a display screen 910having a scroll bar and with the left hand determined to be themanipulating hand. The control unit 140 may arrange the scroll bar alongthe left side of the display screen 910 to correspond to a moving pathof the left thumb. Accordingly, a user can move up and down the scrollbar by dragging it with the user's left thumb. Since the scroll bar maybe arranged along the left side, displayed content may not be hidden bythe thumb and an unexpected touch of the displayed content may beprevented.

FIG. 9 also illustrates an exemplary embodiment of a display screen 920having a scroll bar and with the right hand determined to be themanipulating hand. In such cases, the control unit 140 may arrange thescroll bar along the right side of the display screen 920 to correspondto a moving path of the right thumb. Therefore, a user can move/drag thescroll bar with the user's right thumb without covering or touchingdisplayed content. Accordingly, an unexpected touch to the displayedcontent may be prevented while the user drags the scroll bar. In someother cases, as shown by display screen 930 in FIG. 9, the control unit140 may maintain a normal GUI changeable when both hands are determinedto be the manipulating hand.

FIG. 11 is a flow diagram illustrating a method for displaying a GUIbased on a manipulating hand according to exemplary embodiments of thepresent invention. The method described with reference to FIG. 11 may beapplicable, for example, when a user uses the tactile sensor unit 110 toinput a command to the apparatus 100.

Referring to FIG. 11, the tactile sensor unit 110 may detect a user'scontact (S1110). The user's contact may correspond to the user'sgripping of the apparatus 100. For example, the user can grip theapparatus 100 with one hand as shown in FIG. 12A and FIG. 12B or withboth hands as shown in FIG. 13A and FIG. 13B. When detecting the user'scontact, the tactile sensor unit 110 may transmits the contact detectionsignal, which includes information about the location and pressure ofcontacts, to the control unit 140.

The control unit 140 may receive the contact detection signal from thetactile sensor unit 110 (S1120). Next, the control unit 140 maydetermine the user's contact pattern depending on the contact detectionsignal (S1130). Determination of the user's contact pattern may be basedon information about the location and pressure of contacts. In somecases, the memory unit 120 may store a list of the user's grip forms inconnection with the location and pressure of the user's contacts. Thecontrol unit 140 may retrieve, from the memory unit 120, a specific gripform corresponding to the received information about the location andpressure of contacts. For example, the control unit 140 may determinethat a user's left hand grips the apparatus 100 if two contact detectionsignals from the left sensor part and four contact detection signalsfrom the right sensor part, as shown in FIG. 12A, are received.

Then, the control unit 140 may instruct the display unit 132 to displaya GUI at a specific location on the display unit 132 depending on theuser's contact location (S1140). Specifically, the control unit 140 mayfirst identify the currently executed application (before displaying aGUI), and may then select GUI elements corresponding to the currentlyexecuted application. For example, when an idle screen application isrunning, the control unit 140 may select menu icons as GUI elements foran idle screen. In other cases, if a camera application is running, thecontrol unit 140 may select an icon for taking a photo and a scroll barfor zooming in/out to display. After selecting customized GUI elements,the control unit 140 may determine a GUI arranging pattern based on thecurrently executed application and the user's grip form. For example,referring to FIG. 12A and FIG. 12B, the control unit 140 may recognizean idle screen application as the currently executed application and mayalso determine that the user's left hand is gripping the apparatus 100.The control unit 140 may then determine a GUI arranging pattern suchthat menu icons may be disposed near a contact location of at least oneof four fingers (except the thumb) of the user's left hand.

After determining a GUI arranging pattern, the control unit 140 mayinstruct the display unit 132 to display GUI elements based on the GUIarranging pattern. That is, previously selected GUI elements may bedisplayed on the display unit 132 according to the GUI arrangingpattern.

FIG. 12A and FIG. 12B illustrate two examples of a screen in which menuicons are displayed in an idle screen application according to exemplaryembodiments of the present invention. As shown in FIG. 12A and FIG. 12B,three menu icons may be disposed at positions in a widthwise directionfrom three finger contact locations. The memory unit 120 may storerankings of how frequently the menus and menu icons are used. Thecontrol unit 140 may arrange menu icons in order of the usage frequency.For example, when a user grips the apparatus 100 during the execution ofan idle screen application, the control unit 140 may retrieve the usagefrequency rankings of menus from the memory unit 120 and may instructthe display unit 132 to display menu icons according to the retrievedrankings. The display of icons in the display unit 132 may be changedaccording to the user's preference.

The control unit 140 may also change the location of GUI elementsaccording to the pressure of the user's contact. Referring to FIG. 12Aand FIG. 12B, when the user increases the pressure (e.g., pressureincreases beyond a predetermined pressure threshold) of contacts whilegripping the apparatus 100, menu icons displayed on the display unit 132may move towards the right side of the screen, namely, towards thepressed fingers. Furthermore, the control unit 140 may execute aspecific application when the corresponding icon reaches the right sideof the display unit 132. In some cases, the control unit 140 may decidewhether to execute applications based on the contact pressure of theuser's fingers and/or when the icons reach the right side of the displayunit 132.

The control unit 140 may also change the display size of GUI elementsaccording to the pressure of a user's contact. For example, when theuser increases the pressure of contacts, menu icons displayed on thedisplay unit 132 may be enlarged or reduced in size. An increase ofcontact pressure may highlight menu icons displayed on the display unit132.

FIG. 13A and FIG. 13B illustrate two examples of a screen in whichfunction icons are displayed in a camera application according toexemplary embodiments of the present invention. Referring to FIG. 13Aand FIG. 13B, a user may grip the apparatus 100 with thumbs andforefingers of both hands. An icon for taking a photo may be located ata position close to the forefinger of the right hand, and a scroll barfor zooming in/out may be located at a position in a lengthwisedirection from the thumb of the right hand. If the user increases thepressure of contact by the right forefinger, an icon for taking a photomoves towards the right forefinger. When this icon reaches the upperside of the display unit 132, a function of taking a photo may beexecuted. In addition, the user can increase the pressure of contact bythe right thumb to regulate zooming in/out.

FIG. 14A and FIG. 14B illustrate two examples of a screen on whichfunction icons are displayed in an MP3 application. Referring to FIG.14A and FIG. 14B, a user may grip the apparatus 100 with the left hand.Function icons may be displayed depending on the contact locations offingers of the left hand except the thumb, whereas a volume control barmay be displayed depending on the contact location of the thumb. Thedisplayed function icons may follow a predefined GUI arranging pattern.While gripping the apparatus 100, the user can regulate execution of anMP3 application by increasing a contact pressure or taking an actionsuch as tapping. For example, the location, size, and/or expressioneffect of icons may vary according to the user's contact.

Returning to FIG. 11, after displaying a GUI, the control unit 140 maydetermine whether the user's contact location has changed (S1150).Specifically, when a user changes a grip form while gripping theapparatus 100, the tactile sensor unit 110 may detect a change in theuser's contact and may generate a new contact detection signal. Thecontrol unit 140 may then receive the new contact detection signal fromthe tactile sensor unit 110, may determine the user's contact patternagain, and may modify display of a GUI depending on the new contactpattern.

Referring to FIG. 12A and FIG. 12B, the user's contact in FIG. 12B maybe different than the user's contact in FIG. 12A. For example, thelocation of fingers may have moved downward in FIG. 12B. The controlunit 140 may receive a new contact detection signal from the tactilesensor unit 110 and may determine a new contact pattern based on newinformation about the location and pressure of contacts. The controlunit 140 may then instruct the display of a GUI to change according tothe new contact pattern.

Comparing FIG. 13A and FIG. 13B, the user's right forefinger may havemoved (e.g., to the left) in FIG. 13B, as compared to FIG. 13A. Thecontrol unit 140 may receive a new contact detection signal, determine anew contact pattern, and move the photo icon toward a current forefingercontact, as shown in FIG. 13B.

Referring to FIG. 14A and FIG. 14B, the number of contacts as well asthe location of contacts may change. For example, four contacts on theright side in FIG. 14A may move downward and may be reduced to threecontacts in FIG. 14B. In addition, a contact on the left side may movedownward. A volume control bar may also move downward along the leftside. Additionally, a backward icon, a play/pause icon, and a stop iconmay move downward along the right side, whereas a forward iconcorresponding to a finger (e.g., smallest finger) of the left hand maybe removed from the display unit 132.

As noted hereinabove, exemplary embodiments of the present inventiondisclose a method and apparatus for displaying and modifying a GUIdepending on the location and pressure of a user's contacts.Accordingly, exemplary embodiments of the present invention may preventconfusion when a user manipulates an apparatus.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the invention. Thus, it isintended that the present invention cover the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A method, comprising: detecting a first input ona first surface of an apparatus; determining a graphical user interface(GUI) element based on an application being executed in association withthe apparatus; displaying the GUI element at a first location through adisplay surface of the apparatus, the display surface being differentfrom the first surface; detecting, in association with detecting thefirst input, a second input on the first surface or a second surface ofthe apparatus different from the display surface; displaying the GUIelement moving from the first location towards a second location, thesecond location being associated with a location of the second input;and executing, according to the second input, a function based on theGUI element.
 2. The method of claim 1, wherein the first location of theGUI element is determined according to a location of the first input. 3.The method of claim 1, wherein the second input is a pressure of thefirst input.
 4. The method of claim 1, wherein the second input is a tapon a location of the first input.
 5. The method of claim 1, whereinexecuting the function comprises executing an application correspondingto the GUI element.
 6. The method of claim 1, wherein executing thefunction comprises changing at least one display characteristic of theGUI element.
 7. The method of claim 1, wherein the first input is acontact to a tactile sensor located in association with at least onelateral side of the apparatus.
 8. The method of claim 7, whereindetermining the GUI element comprises determining a GUI arrangingpattern based on the executed application and a contact pattern of thefirst input.
 9. An apparatus, comprising: a display comprising a displaysurface; at least one sensor configured to: detect a first input on afirst surface of the apparatus, the first surface being different fromthe display surface; and detect, in association with detection of thefirst input, a second input on the first surface or a second surface ofthe apparatus, the second surface being different from the displaysurface; and at least one processor configured to: determine a graphicaluser interface (GUI) element based on an application executed inassociation with the apparatus; cause, at least in part, the display todisplay the GUI element at a first location through the display surface;cause, at least in part, the display to display movement of the GUIelement from the first location towards a second location associatedwith a location of the second input; and execute, according to thesecond input, a function based on the GUI element.
 10. The apparatus ofclaim 9, wherein the first location of the GUI element is determinedaccording to a location of the first input.
 11. The apparatus of claim9, wherein the second input is a pressure of the first input.
 12. Theapparatus of claim 9, wherein the second input is a tap on a location ofthe first input.
 13. The apparatus of claim 9, wherein the at least oneprocessor is configured to execute an application corresponding to theGUI element.
 14. The apparatus of claim 9, wherein the at least oneprocessor is configured to cause, at least in part, a change to at leastone display characteristic of the GUI element.
 15. The method of claim9, wherein: the at least one sensor comprises one or more tactilesensors disposed in association with at least one lateral side of theapparatus; and the first input is a contact to at least one of the oneor more tactile sensors.
 16. The method of claim 15, wherein the atleast one processor is configured to determine a GUI arranging patternbased on the executed application and a contact pattern of the firstinput.
 17. The method of claim 1, wherein the function is executed inresponse to the GUI element reaching the second location.
 18. The methodof claim 17, wherein the GUI element is further determined based on ausage frequency of the GUI element relative to a plurality of GUIelements.
 19. An apparatus, comprising: at least one processor; and atleast one memory comprising one or more sequences of one or moreinstructions that, in response to being executed by the at least oneprocessor, cause the apparatus at least to: detect a first input on afirst surface of the apparatus; determine a graphical user interface(GUI) element based on an application executed in association with theapparatus; cause, at least in part, the GUI element to be displayed at afirst location through a display surface of the apparatus, the displaysurface being different from the first surface; detect, in associationwith detection of the first input, a second input on the first surfaceor a second surface of the apparatus different from the display surface;cause, at least in part, displayed movement of the GUI element from thefirst location towards a second location, the second location beingassociated with a location of the second input; and execute, accordingto the second input, a function based on the GUI element.
 20. Theapparatus of claim 19, wherein the at least one processor is configuredto execute the function in response to the GUI element being at thesecond location.